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(54) linage processing device and method for sensing moving objects and rangefinder employing the 
same. 



@ An image processing device and method for detecting moving objects against complex moving 
backgrounds, and a rangefinder based thereon are disclosed. The device and method are applicable to 
rapid and selective evaluation of complex visual fields, without the need for extensive numerical 
processing. The disclosed image processing method comprises the steps of obtaining sequential video 
frame data ; storing video data in memory for a consecutive series of video frames obtained over a 
predetermined time interval in the past at a predetermined sampling rate ; obtaining a standard image 
by averaging the video data stored in memory for the predetermined time interval so as to obtain video 
data representing a composite image for the predetermined time interval ; and subtracting the video 
data for the standard image from video data for a current video frame. 
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The present invention pertains to equipment and methods for image processing, and more particularly, to 
image processing equipment and methods suitable for detecting moving objects and for assessment of complex 
visual fields containing moving objects, including assessment of the distance between a moving object and a 
reference point in such a visual field. 
5 Video cameras offer a number of advantages as input devices for systems which rely on visual data. They 

are lightweight, relatively inexpensive and can be used in a variety of hostile environments which humans tol- 
erate poorly, or not at all. Video cameras find wide application in security and surveillance systems, for process 
control, assembly control, customer and personnel monitoring, as well as for many other uses. For example, 
by means of a television system, one guard can monitor an extensive area, indoors and outdoors, from a climate 
10 controlled room. When real time monitoring is unnecessary, video signals from one or more cameras can simply 
be recorded on magnetic tape and viewed later as the need arises. 

Despite the above described advantages of the video camera input devices, however, conventional video 
based surveillance and intrusion detection systems, motion sensors, monitoring systems and the like present 
one significant drawback in that someone must constantly view one or more video displays whenever real time 
is monitoring is necessary. For this reason, it becomes expensive to operate these systems. In view of this 
shortcoming, various attempts have been made to develop systems whereby reliable computer analysis of 
video signals can be achieved, thereby permitting unattended automated or semiautomated operation. 

Conventionally, methods and devices for detecting moving objects, and for assessment of visual fields con- 
taining moving objects have involved application of various types of mathematical operations to sequentially 
20 obtained images from a video camera. Examples include methods wherein sequentially obtained images of a 
given visual field are analyzed by using Fourier transform and digital or analog filtering techniques so as to 
determine whether there is an moving object in a frame. 

Because of the complexity of most video signals, with any of the above described methods, in order to 
obtain reasonably precise and reliable results, high speed numerical processing equipment is an absolute 
25 necessity, especially when real time analysis is desirable. Consequently, conventional systems for analysis of 
visual fields containing moving objects have been very costly due to the expense incurred for the requisite high 
speed data processing facilities. Furthermore, the selectivity of conventional equipment of this type has been 
inadequate, with the result that spurious results are quite common with use thereof, particularly so when used 
under circumstances where the background is complicated and moving such as in outdoor applications. This 
30 problem relates to the fact that presently available methods and equipments are fundamentally based on a 
methodology for detecting a foreign object out of a visual field obtained at cirtain time. In other words, the 
theoretical background of the above mentioned conventional methods and equipments have not been based 
on the concept to detect an abnormal conditions based on the analysis of stationary time series. 

One additional drawback of conventional motion detecting and monitoring devices and methods is that gen- 
35 erally a single video camera is used for each visual field , for which reason only two dimensional data is provided. 
Accordingly, when distance factors are of importance, these systems tend to be inadequate. When monitoring 
hazardous areas, for example, when someone appears to be approaching the point of danger, distance data 
is helpful for evaluating the urgency of a response to the situation, a feature which the conventional devices 
do not offer. 

40 In consideration of the above, it is an object of the present invention to provide an image processing method 

and device which is capable of reliably and selectively detecting a target moving object, and which can do so 
even when the background is complex and in motion. Furthermore, it is an object of the present invention to 
provide a totally nonmechanical rangefinding device based on the above described image processing method 
and device. 

45 In order to achieve the above object, the present invention is based on analytical methods for stochastic 

processes. Actual visual image data consists a set of values as a function of both time and location, each value 
corresponding to visual data such as brightness of a predetermined location at a predetermined time. According 
to the present invention, a moving object is recognized as a remarkabe deviation of data from standard along 
the time axis. The standard visual image is obtained by averaging visual images obtained during a period of 

so time which is determined according to the probabilistic characteristics of both the visual image and expected 
event to be detected. This method is practical especially when the visual image is stationary or approximately 
stationary because it is expected in such a case that any normal event should fall within a predictable distribution 
which is obtained by a certain period of time preceeding the event An event which is out of the predictable 
probabilistic distribution is a moving object in a stationary background, for example. 

55 To achieve this object, the present invention provides an image processing method for detecting moving 

objects comprising the steps of: 

a) obtaining sequential video data representing a consecutive series of video frames; 

b) storing video data in memory for a consecutive series of video frames obtained over a predetermined 
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time interval in the past at a predetermined sampling rate; 

c) obtaining a standard image by averaging the video data stored in memory for the predetermined time 
interval so as to obtain video data representing a composite image for the predetermined time interval; and 

d) subtracting the video data for the standard image from video data for a current video frame. 

5 Additionally, the present invention provides an image processing device for detecting moving objects com- 

prising: 

a) memory means for storing video data; 

b) standard image generating means to which sequential video data representing a consecutive series of 
video frames is provided, whereby: 

10 i) sequential video frames captured at a predetermined sampling rate over a predetermined time interval 

in the past are stored in the above mentioned memory means, and 

ii) video data for a standard image is generated and output, the standard image obtained by averaging 
the sequential video frames for the predetermined time interval stored in the memory means so as to 
obtain a composite image for the predetermined time interval; and 
15 c) subtraction means for subtracting the video data for the standard image from video data for a current 

video data frame. 

Brief Description of the Drawings 

20 Fig. 1 is a block diagram showing the overall layout of a first preferred embodiment of the present invention. 

Fig. 2 is a time sequence for illustrating the general concept of a motion detecting method employed in the 
first preferred embodiment of the present invention. 

Fig. 3 is a block diagram showing the layout in detail of the first preferred embodiment of the present inven- 
tion. 

25 Figs. 4(a) through 4(h) are time charts for illustrating the operation of the first preferred embodiment of the 

present invention. 

Fig. 5 is a block diagram showing the overall layout of a second preferred embodiment of the present inven- 
tion. 

Fig. 6 is an overhead view schematically illustrating the video camera placement in the second preferred 
30 embodiment of the present invention. 

Fig. 7 is a schematic diagram for illustrating the procedures whereby the distance up to a moving body is 
determined according to the present invention. 

Fig. 8 is a schematic diagram illustrating the operation of an application of the present invention. 

35 Description of Embodiments 

In the following, a first preferred embodiment of an image processing device in accordance with the present 
invention will be described with reference to Figs. 1 through 4 (h). 

In Fig. 1, a block diagram can be seen illustrating the overall layout the device of the present embodiment. 

40 An image processing method in accordance with the present invention serves as a basis for general operation 
of the device shown in Fig. 1, the time sequence of which is schematically illustrated in the time chart of Fig. 
2. In Fig. 1, a standard image generation circuit 2 can be seen to which data derived from the output signal of 
a video camera focussed on a given visual field is sequentially supplied, one video frame at a time, at a frame 
interval given by At The output signal of standard image generation circuit 2 at time t corresponds to a com- 

45 posite standard image St, which represents the result of averaging n consecutive video frames supplied t 
minutes previously to standard image generation circuit 2, at a frame interval given by At, where At ^ At 

Composite standard image S t represents an image of static elements in the visual field, that is, composite 
standard image St represents the nonmoving background from which images of moving objects in the visual 
field have been eliminated through the averaging operation. Subtracting composite standard image S t from the 

so current video frame captured at time t results in an image showing only objects which can be considered as 
foreign objects in the visual field at time t, that is, objects which are not part of the static background. . 

To describe the operation of the device of the present embodiment more specifically, a video frame cap- 
tured at current time t expressed as an I by j matrix of pixel values is converted to a vector representation thereof, 
as given by Dg(dy, t) which is then stored in current frame memory 1, shown in Fig. 1. Simultaneously, the vector 

55 representation of composite standard image S t as given by S t j(s ijr t), which will subsequently be subtracted in 
subtracter 4 from the current matrix stored in current frame memory 1, is stored in standard image memory 3. 
Vector representation S^Sy, t), as obtained from standard image generation circuit 2 and stored in standard 
image memory 3, represents the result of individually summing and averaging the corresponding pixels for n 
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consecutive v.deo frames captured , minutes prior to time t the vector representations of which are given by 
_ Drf*"*). D 0 (t-t-DT), D,(t-r-2AT) D fl (t-r-(n-1)At). 

When the average of these matrices is calculated, each pixel of the resulting vector representation S„(s„ 0 is 
given as shown in Equ. 1 below: ' *' 



_ n 

dij = Z dij/n Equ _ ! 

L, JT' n » m ° V iT 9 . .° bj t Ct PaSS6d thr ° U9h thS field durin9 me samD,in 9 Deriod ' assumi "9 ^ sP^d thereof 
issufficientjyrapid, the objectwai most often be at adherent position for each frame, for which reason following 
averaging operabon, the moving object dissappears from the resulting composite standard image S„ and thus 
only background rema.ns. Ukewise, momentary changes in ambient light intensity and the like disappear with 
averaging. It can therefore be appreciated that objects passing through the visual field from time t- , - (n - 1)At 

S £f£™ I a " n ° S ! a T yS abSenti " theavera 9 ed ima 9e- This is an importantfeatureof the present invention 
nthat trough a relatively simple mathematical operation, even the most complex backgrounds can be reliably 

toTtaS T£°!!! y r J* "f ° SSible t0 e ' iminate 3ny subse ° uent ima 9« processing of data corresponding 
to state elements in the video frame, m this way largely limiting subsequent processing to objects of interest 
Applying the above described operations and assumptions, the pixel matrix for composite standard image 
S, at time t is given by the following Equ. 2: 



Sij(Sij, t) = 1/nZ Dij<t-T-<n-l)At) E qu. 2 

Vector representation S^j, t) as calculated in Equ. 2 above has the following characteristics- 

root of 8 !! 9 " 81 10 n0ISe rati ° COrresponding to composite standard image S, is improved by a factor of a square 

SL^T* ° f V^T ° bjeCt ° r th8 Mke PreSent in any one of me n video ^mes from which composite 
Sn d and B * * ^ ° f 1/a a " d dtesaDDears for a sufficently large value 

I iJfhfr!* ofmomenta . r y Changes in lighting and momentary changes due to precipitation, shifting clouds 
and the like is largely eliminated through the averaging operation 

h„ <?Z T "! • P ' evi T' y : ' n SUDtractor 4 ' the vector representation of composite standard image S t as given 
by t) which is stored in standard image memory 3 is subtracted from the vector representation of the cur- 
rent frame as given by Dtfd,. t) which stored in current frame memory 1. In this way, for each current frame 
vector representation supplied at sampling rate of Ax and stored in current frame memory 1. a vector repre- 

^ZZIZZIT"*" 9 C ° mP0Si l e Standart ima9C 81 Ca,CU,ated in Standart ima 9 e generation circuit 2 
oo2Zln c !> T^ T^ 3 ' S subtracted therefrom in subtracter 4. The resultof each subtraction 
ZT* 1 subtrac *or 4, which ,s a vector representation of any foreign moving objects in the visual field at 
time t, is then stored in moving object memory 5, as seen in Fig. 1 

in ?! P °! Sta " dard im39e 9enera «on circuit 2 and standard image memory 3 will be described 

n greater detail w*h reference to the block diagram of Fig. 3. In this figure, an A/D converter 10 can be seen 
!?,™Sk W » aftjndamental dock si 9" al CL ha ving a period of At. the analog current video signal which is 

7S2 UTi ' S hh ^ 3 di9ita ' CUrrent Si9 " al Whfch is then supp,ied to «™» *-« ^ 
Tr, Ihh v "J?" 141 ttUOUBh 14n WhiCh Wi " be described further on - "h^ 6 " represents a frame counT 
.nJl^T f™^ 10, ab ° Ve mentioned fandamsmal clock signal CL is supplied to a frame 

memory address counter 11, wherein an address signal AD and a frame signal FR are generated in concert 
with the supphed clock signal. Address signal AD sequentially output from frame memory address 

ow anSSe S ta„Tpr^ me TT, 1 ^ to tame m>mo * unte 1 5 ' mrou 9h 1 5 n which will be described 
pST'n!? J!T !2 18 sequent,al, y su PP ,ied to 3 ^me selection counter 12. According to frame signal 
2 th^h IT T me ™* address hunter 11, frame selection counter 12 generates selector signals 

Scr, iTsunSrf IT * SUPP " ed t0 3 corres P° ndln 9 9 ate "1 through 13„, and a control signal CD 

wmcn is supplied to a selection circuit 16. 

th. ™l naJ H am ° n9 - S l eCt0r i i9 " alS CS1 thr0U9h which has a hioh ,evel «lue results in the opening of 

s^'Tfh 9 9 * 1' reSU,t ** the ° Utput Signal of me oorresponding frame memory unit 15, 

S ft? £ i «. CO, : e T nd,n9 ^ 14h ^ d6SCribed ab0ve ' with eaoh » utee of Omental clock signal 
CL, the d.g.tal current video signal from A/D converter 10 is supplied to each of adders 14, through 14„ and 
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address signal AD from frame memory address counter 11 is supplied to each of memory units 15 1 through 
15 n . As a consequence, for any of selector signal CS 1 through CS n with a high level, the current output of the 
corresponding memory unit 15) is added to the digital current video signaJ in the corresponding adder 14 f? the 
result of which is again stored in that memory unit 1 5, at the memory location therein indexed by address signal 

5 AD. Conversely, for any of selector signal CS^ through CS n with a low level, the current output of the corre- 
sponding memory unit 15) is simply again stored in that memory unit 15i at the memory location indexed by 
address signal AD. As this process takes place over time, each of memory units 1 5-t through 15 n comes to hold 
video frame data for multiple video frames. 

As mentioned above, control signal CD output from frame selection counter 12 is supplied to a selection 

10 circuit 1 6. On this basis, the output csignal of one of frame memory units 1 5j through 1 5 n is output via selection 
circuit 16 and supplied to a multiplier 17. In multiplier 17, the supplied value is muliplied by 1/n, the result of 
which is supplied to a subtracter 18 which also receives an output signal from current frame memory 1. The 
value supplied to subtracter 1 6 from multiplier 1 7 is subtracted from the value supplied from current frame mem- 
ory 1, thereby obtaining video data R which is then stored in moving object memory 19. 

15 The operation of the present embodiment as thus described will now be explained with reference to the 

time charts of Figs. 4(a) through 4(h). For the sake of simplicity, the case in which any composite standard image 
S is composed of only three frames will be considered. 

To start, after the device has been activated, a composite standard image S 0 for time t=0 must be calculated 
in standard image generation circuit 2 and stored in standard image memory 3 as a basis for subsequent pro- 

20 cessing. To do so, the current output signal of the video camera employed is converted to a digital video signal 
A in A/D converter 10, the result of which is stored in current frame memory 1 and supplied to adders 14 1f 14 2 
and 14 3 . Based on the frame signal FR output from frame address counter 11, selector signal OS, supplied 
from frame selection counter 12 to gate 13t is low, as is shown in Fig. 4(b), for which reason digital video signal 
A in adder 14 1 is stored without change in memory unit 15i at the memory location therein indexed by address 

25 signal AD from frame memory address counter 11, as shown in Fig. 4(e). Although selector signals CS 2 and 
CS 3 are high, during initialization there is no preexisting video data for composite standard image S since the 
device has just been activated. As a result, the addenda in adders 142 and 14 3 is zero, for which reason video 
signal A is likewise stored unchanged in memory units 15 2 and 15 3 at the memory location indexed by address 
signal AD as can be seen in Figs. 4(f) and 4(g). 

30 At time t=1 when digital video signal B is supplied from A/D converter 1 0 to adders 14 1t 14 2 and 14 3 , selector 

signals CS-i and CS 3 are high, whereas selector signal CS 2 is low, with the result that video signal A+B is stored 
in memory units 15 1 and 15 3 at the memory location currently indexed by address signal AD, whereas video 
signal A is again stored in memory unit 15 1 at the memory location indexed by address signal AD. In consider- 
ation of the above, and with reference to Figs. 4(a) through 4(h), it can be appreciated that at time t=2 when 

35 digital video signal C is supplied from A/D converter 1 0 to adders 14 1t 14 2 and 14 3 , and when selector signals 
CS-, and CS 2 are high and selector signal CS 3 is low, video signal A+B+C is stored in memory unit 15 1 , video 
signal B+C is stored in memory unit 15 2 , and video signal C is stored in memory unit 15 3 . 

At time t=3, digital video signal D is supplied from A/D converter 10 to adders 14 1( 14 2 and 14^ selector 
signal CS 1 is low and selector signals CS 2 and CS 3 are high, with the result that video signal D is stored in 

40 memory unit 15 1t video signal B+C+D is stored in memory unit 15 2 and video signal C+D is stored in memory 
unit 15 3 . Additionally, a control signal CD which selects memory unit 15 1 is now supplied to selection circuit 
16, with the result that video signal A+B+C which was stored in memory unit 15! at time t=2 is supplied to mul- 
tiplier 17 via selection circuit 16. In multiplier 17, video signal A+B+C from memory unit 15i is multiplied by 1/n 
which is 1/3 in the present example, whereby the average of video signals A, Band C is determined and supplied 

45 to subtracter 18, wherein this average value is subtracted from the current output of A/D converter 10 which is 
video signal D, the result of which is stored in moving object memory 19 as video data R. 

The above described operation continues as long as the device is in operation, and as can be seen in Fig. 
4(h), for the three frame model, the value for video data R consecutively calculated in subtracter 18 and stored 
in moving object memory 19 is the result of subtracting the average video signal for the preceding three sam- 

so pling periods from the video signal for the current sampling period, i.e. the value for video data R consecutively 

stored in moving object memory 19 for t=3, t=4, t=5, t=6 is D-(A+B+C)/3, E-(B+C+D)/3, F-(C+D+E)/3, G- 

(D+E+F)/3 Analagous results are obtained for more than three frames. 

In Fig. 5, a block diagram showing the overall layout of an example of a motion sensor with range finding 
capabilities in accordance with the present invention is shown. 

55 Serving as video input devices, two video cameras 20L, 20R can be seen in Fig. 5. Each of video cameras 

20L, 20R is mounted at a fixed position with a predetermined space therebetween and a predetermined orien- 
tation. Electronically controllable zoom lenses are used so that the magnification of each can be set to a desired 
value. 
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MR -2 ^ eference K to fa- 6 ; the relationship between the placement and orientation of video cameras 20L. 
20R and movmg objects m the visual field will be described with reference to Fig. 6. The optical axis of each 

soas to ST r 20R r ,abe,ed 88 ^ and ^ and - ™ * *. « «22S 

D in r£ LrIr P K2,° n I an K 0ther - ,ateral dfetanCe betWeen video «™« »U 20R is labeled 

Th^ c d ^7; respectlve, y- The for as and Ov* vary depending on the chosen lens magnifications 

I overtan SI™ TJt* 6 , dSViCe ° f ^ embodime "» functions is defined b^eg.on 

or overlap of the visual fields of v.deo cameras 20L, 20R. As should be obvious from the above discussion the 

In^lLT *\ f0f ^ dSViCe 38 8 Wh0te Can be varied to suit requirements by varying Z T^gS™ 
labeled as 1^. V ~""« 20L ' 20R - A " inking into the visua. field JLJU^^ITJSS 

thJZl 'InT" 4 Si9na ! S ° f Vide ° C3meraS 20L> 20R ' ^ si 9 nals ^ and VR - respectively are derived 
^ch rep^ ntja , vjdeo frames fay ^ ^ J V aenved 

SS^S^ ' * ~ ^ ,nte,Val 9 ' Ven by At ^ Si9nals ^ and VR ««» aerated and output are 

Sr e a C h ilcf tit r v n9 object detection means 21L - 2ir m ^ *S« 0***™ mean ™ 

to movlno Z.l rT V ° f 8 Vlde0 Si9nal PrOCeSSin9 Cl,CUrt Which acls to extract data corresponding only 
to mov.ng objects from the supplied video signals VL. VR. in this way subracting out background The acS 

meT^„? m °T 9 deteCti ° n meanS 21U 21R iS identical to *■* ° f the preferL embLTmen^of 
SKI n ^°" a l deSCri ^ d ? ariier " and f0rthat reaso "' thereof wilfnot be repeated Ou^u 
signals VML, VMR of mov.ng object detection means 21 L, 21R, respectively, contain data representations of 
mung objects only in their respective visua. fields, and are both supplied to a coordinate Nation means 

Returning again to Fig. 6, the optical centers of each of video cameras 20L. 20R lie on an imaginary line 

I»2nTi2f " . ; ma9ina 7 B iS ShOW " in * e draWin9 *** passes *° moving o D ?^ l z 

which « para lei to imaginary line A. The focal plane of each of video cameras 20L. 20R lie on an imaginary 
hne C shown « F,g. 6. and the horizontal distance between line A and line C is given by d. The diste^e wWch 
iTneAa'^ 

earned "TttRM^r^"*" * 3 »** P * ^ the ° bJect * Within the visual fleld of "oth of 
ZZlrl .>n? k P t ' me ' 0,0 P ° mt 31 which ima 9 e of ob ject M intersects the focal plane of 

T 85 P ° im ^ The diStanC6 between P° int P * and »• °P«cal axis of camera 20Lin the 
focal plane thereof « grven by x,. Similarly, the point at which the image of object M intersects the focal olane 

Z^o^Zo^ VE?-* Xb " ^ PreVi0US,y menti ° ned COOrdinate calculatina rneans 22 calculated 
Tn^h E£ distances x,, and x,,. and supplies them to a distance calculation means 23. 

to ^\T n zz:T ,s of the various re,afcnships described above and ShOW " f *- 6 ' the **■ 

^ x L^d = D/(x a -x b ) Equ.4 
transformation of which yields Equ. 5 below: 

0 . ^ L = d-D/(x a - Xb) Equ. 5 
Similarly, the following Equ. 6 can be obtained: 

. . = D^Xa-Xb) Equ. 6 
transformation of which yields Equ. 7 below: 

L = md-D/(x a -x b ) Equ. 7 

h win kIT 9 ^ I 19 ,* 7 V the relationshi P between focal length f of each of cameras 20L, 20R and distance 

^i^^^J'T fl9U H e ' lens 12 has a focal len9th 9iven by f - An ob *« x^!22S 

STn S f ' ,S PrOJeCted f0r 3 length X ° n 1116 focal P ,ane of lens ^ The distance from lens 

LZ to the foca. plane thereof ,s given by d. From these relationships, the following equations can be derived 

X/L = x/d Equ. 8 
c c n x/(d-0 = Xff Equ. 9 

From Equ. 8 and 9, Equ. 10 below is obtained: 

L = df/(d-f) Equ. 10 
In the same way, Equ. 1 1 below is obtained: 

^ L . . _ d = fl_/(L-f) Equ. 11 

Combining Equ. 7 and 11, Equ. 12 is obtained: 

T , . _ L = mD-fUfXa - Xb)(L . f) Equ. 12 

Transforming Equ. 12 gives Equ. 13: 

L = f(1 + mD/(X a -X b )) Equ. 13 
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By making distance D between cameras 20L, 20R sufficiently large, mD » X a - Xt,, on which basis the 
right side of Equ. 13 can be approximated and simplified to give Equ. 14 below: 

L = mfD/(X a -X b ) Equ. 14 
Based the above described mathematical relationships, from distances x a , x b , the distance L separating object 
5 M from cameras 20L, 20R can be calculated using Equ. 13. 

[Application of the present Invention] 

The application using the image processing device on a high voltage power line will be described. Fig. 8 is 
10 a schematic diagram illustrating the operation of an application of the present invention. In Fig. 8, a restricted 
area 31 is provided around the power line 30. Coordinates (xL.yL) of the power line 30, a distance (rc) from 
the power line 30, to the border plane of the restricted area 31 , and the distance (La, Lb) from the video cameras 
20L and 20 R to the edges of the restricted area 31 , are stored in a fixed memory. In this case, the coordinated 
(x.y) of the moving object M on the monitor, and the distance L, are calculated by the operation described. The 
15 distance from the video cameras 20L and 20R to the moving object M, are supplied to a controller (not 
shown).The controller distinguishes, based on the distance L, whether there is a moving object M between dis- 
tance La and distance Lb.lf there is a moving object M in the distance of Lb-La, the controller distinguishes 
whether the moving object M is in the restricted area 31 or not, based on the coordinates (x,y) using the following 
Equ. 15 

20 Da = SQR((x-xL)$ + (y-yL)$) Equ. 15 

The label Da shows a distance from the moving object M to the power line 30. It is assumed that the power 
line 30 does not change the coordinated, and the restricted area 31 is ftxed.lf the power tine 30 is constructed 
diagonally to the front of the video cameras 20L and 20R, the distance Da is calculated on the distance (L) of 
the moving object (M), and the (XY) coordinates of the power line 30.lf the distance Da is shorter than the dis- 

25 tance rc, the controller distinguishes the moving object (M) comming into the restricted area 31 , and gives a 
warning or removes the moving object (M). As described above, in this application, the device detects the mov- 
ing object (M), which comes into the view of the cameras 20L and 20R, measures the distance L to the moving 
object (M), distinguishes that the moving object (M) comes into the restricted area 31 .Although the moving 
object detection 21 L and 21R, are constructed with hardware in the above described embodiments, it may be 

30 verified with software. The coordinate calculation 22, and the distance calculation 23, are also verified with 
software. 



Claims 

35 

1. An image processing method for detecting moving objects comprising the steps of: 

a) obtaining sequential video data representing a consecutive series of video frames; 

b) storing said video data in a memory for a consecutive series of video frames obtained over a pre- 
determined time interval in the past at a predetermined sampling rate; 

40 c) obtaining a standard image by averaging the video data stored in memory for the predetermined time 

interval so as to obtain video data representing a composite image for the predetermined time interval; 
and 

d) subtracting the video data for the standard image from video data for a current video frame. 

45 2. An apparatus for detecting moving objects comprising 

a) memory means for storing video data; 

b) standard image generating means (2)for generating and outputing a standard image, to which 
sequential video data representing a consecutive series of video frames is provided, so arranged that : 

i) sequential video frames captured at a predetermined sampling rate over a predetermined time 
so interval in the past are stored in said memory means (1), and 

ii) video data for a standard image is generated and output, the standard image obtained by averag- 
ing the sequential video frames for the predetermined time interval being stored in the memory 
means so as to obtain a composite image for the predetermined time interval; and 

c) subtract ion means (4) for subtracting the video data for said standard image from video data for a 
55 current video data frame. 

3. An image processing method in accordance with claim 1 , 

comprising, when sais sequencial video data representing a consecutive series of video frames is 
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obtained, temporarily storing each consecutive video frame in a currrent frame memory, and subtracting 
the video data for the standard image is subtracted from the video data stored in said current frame mem- 
ory. 

Rangefinder for measuring moving objets comprising: 

a) first input means (20L), taking, in images of objects which moves in a visual field, has a variable mag- 
nification and an optical axis, which is oriented to a predetermined direction; 

b) second image imput means (20R), taking in images of objects which moves in a visual field, which 
is mounted at a predetermined distance from the first image input means, has a variable magnifi- 
cation,and an optical axis which is oriented tobe parallel with the optical axis of the first image input 
the visual field having a region of overlap with the visual field of the first image input; and 

c) distance calculation, for calculating a distance from the first and second image input of the moving 
objects, based on positions of the moving objects wich are taken by the first and second image input 
means. K 

Rangefinder for measuring moving objects in accordance with claim 4 , characterized in that the first and 
second image input means responds either to visible rays or invisible rays, including one or more of 
ultraviolet rays, infrared rays, X-rays and laser radiation. 
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FIG.5 
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